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ABSTRACT 

A general formula for the correlation function in redshift space is derived 
in linear theory. The formula simultaneously includes wide-angle effects and 
cosmological distortions. The formula is applicable to any pair with arbitrary 
angle 9 between lines of sight, and arbitrary redshifts, z\, z 2 , which are not 
necessarily small. The effects of the spatial curvature both on geometry and 
on fluctuation spectrum are properly taken into account, and thus our formula 
holds in a Friedman-Lemaitre universe with arbitrary cosmological parameters 
flo and Ao- We illustrate the pattern of the resulting correlation function with 
several models, and also show that validity region of the conventional distant 
observer approximation is 9 < 10°. 
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1. INTRODUCTION 

Ever since the pioneering work of Totsuji & Kihara (1969) and Peebles (1974), the 
two-point correlation function of galaxies has been one of the most fundamental tools 
in analyzing the large-scale structure of the universe. Recently, prominent advances in 
galaxy redshift surveys have been taking place (for review, see Strauss 1999), and upcoming 
large-scale galaxy and QSO surveys, notably the Two-Degree Field Survey (2dF; Colless 
1998; Folkes 1999), and the Sloan Digital Sky Survey (SDSS; Gunn k Weinberg 1995; 
Margon 1998), will provide three-dimensional, large-scale redshift maps of galaxies and 
QSO's. The two-point correlation function will play one of the central role in the analysis 
of such large-scale redshift maps. 

In redshift surveys, the distances to objects are measured by recession velocities, and 
thus the distribution of objects in redshift space is not identical to that in real space. The 
clustering pattern is distorted by peculiar velocity fields (Kaiser 1987), and, for high redshift 
objects, also by cosmological warp of real space on a light-cone (Alcock & Paczyhski 1979). 
Such effects are called as redshift distortions. These effects on the linear power spectrum 
and on the linear two-point correlation function have been investigated by many authors 
(for review, see Hamilton 1998) 

Most of the work is for redshift distortions in a nearby universe and assumes z <C 1. 
Kaiser (1987), in his seminal paper, derived the linear redshift distortions of the power 
spectrum for a nearby universe, employing the distant-observer approximation, which 
assumes the scales of fluctuations of interest are much smaller than the distances to the 
objects. Generally, the redshift distortions by peculiar velocities are along the line of sight. 
This radial nature of distortion introduces a statistical inhomogeneity into the redshift 
space. In the distant-observer approximation, such inhomogeneity is neglected and the 
statistical homogeneity is recovered, while the anisotropy is introduced, instead. The 
Fourier spectrum has maximal advantage when the statistical homogeneity does exist, thus, 
for this reason, Kaiser's formula has a very simple form. Hamilton (1992) transformed 
Kaiser's formula of the power spectrum to the formula of the two-point correlation function, 
using the Legendre expansion (see also Lilje & Efstathiou 1989; McGill 1990). 

Despite the simple form of the formula, the distant-observer approximation is not 
desirable in the sense that we cannot utilize the whole information of the survey within 
this approximation. The wide-angle effect, which is the contribution of an angle 9 between 
lines of sight of two objects to the correlation function, affects the analysis of the redshift 
maps when we intend to use the whole data of the survey. Therefore, the analysis of 
wide-angle effect on the correlation function in linear theory (Hamilton & Culhane 1996; 
Zaroubi & Hoffmann 1996; Szalay, Matsubara & Landy 1998; Bharadwaj 1999), as well as 
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the spherical harmonic analysis (Fisher, Scharf & Lahav 1994; Heavens & Taylor 1995), are 
of great importance. 

All the above studies are for a nearby universe, and assume z < 1. This condition 
is not appropriate for modern galaxy redshift surveys (z ~ 0.2) or QSO redshift surveys 
{z ~ 2). The evolution of clustering and the nonlinearity in the redshift-distance relation 
introduce the cosmological redshift distortion on the correlation function. Ballinger, Peacock 
& Heavens (1996) and Matsubara & Suto (1996) explored this effect in power spectrum and 
correlation function, respectively, both employing the distant-observer approximation (see 
also Nakamura, Matsubara & Suto 1997; de Laix & Starkman 1997; Popowski et al. 1998; 
Nishioka & Yamamoto 1999; Nair 1999). The more the depth of the redshift surveys is 
increasing, the more the cosmological redshift distortion becomes important. 

So far the previous formulas for two-point correlation function in redshift space are 
restricted either to nearby universe, or to distant-observer approximation. The purpose 
of the present paper is to derive the unified formula for the linear redshift distortions of 
the correlation function, fully taking into account the wide-angle effects and cosmological 
distortions, simultaneously. In this way, we do not have to think about which formula we 
should use depending on the value of z and 9. In addition, the effects of the spatial curvature 
are also included in our formulation and our formula applies to Friedman-Lemaitre universe 
with arbitrary cosmological parameters Qq and Ao- Our formula turns out to correctly 
reproduce the known results if we take appropriate limits of the formula. 

In §0, the redshift-space distortions of density fluctuations toward radial directions 
are derived on a light-cone, which include the evolutionary effects. In §^|, the formula 
for correlation function in redshift space is derived separately for open, flat, and closed 
models. Demonstrations of redshift distortions in several cases and the validity region 
of the conventional distant observer approximation are given in The conclusions are 
summarized in §[|. 

2. LINEAR REDSHIFT-SPACE DISTORTIONS ON A LIGHT-CONE 

2.1. Radial Distortion of Linear Density Field on a Light-cone 

Throughout the present paper, we assume the Friedman-Lemaitre-Robertson- Walker 
(FLRW) metric as the background space-time of the universe. According to the sign of the 
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spatial curvature K, the metric is given by 

f fl2 W r 



ds 2 = -c 2 <it 2 + <( 



c?X + sinh + sin z 

— K L 

a 2 (t) \dx 2 + X 2 (d6 2 + sin 2 
a 2 (t) 
if 



<ix 2 + sin 2 x(d0 2 + sin 2 



{K < 0) 
(if = 0) 
(K > 0) 



(2.1) 



where 9 and are usual angular coordinates, and x is a radial comoving coordinate. In 
the following, we choose a unit system, c = 1, and ifo = 1, where H = 100/ikm/s/Mpc 
is the Hubble's constant, so that comoving distances are measured in units of 
cHq 1 = 2997.9/i~ 1 Mpc. In this unit system, the spatial curvature K is then given 
by 



K = tt + \ - 1, 



(2.2) 



where the scale factor at present is normalized as do = 1. From the FLRW metric, we define 
the three dimensional metric 7^ as 



ds 2 



-dt 2 + a 2 ^ijdx l dx 3 ' . 



(2.3) 



That is, the tensor 7^ is the metric for a three-space of uniform spatial curvature K. In the 
following, vectors with Latin indices represent the three-vector in the three-space specified 
by the metric 7^. 



The comoving distance x at redshift z is given by 

, dz' 

x(z) 



lo H{z'Y 

where H(z) is the Hubble parameter at (comoving) redshift z: 
H(z) = 



1 + z)m + (1 + zf{\ - fi - A ) + A . 
The radial comoving coordinate x an d the comoving distance x are related by 



X 



\K\ l l 2 x(z), (K^O) 
x(z). (K = 0) 



(2.4) 



(2.5) 



(2.6) 



Provided that a cosmological model is fixed, the comoving distance Xi an d the redshift z 



are related through equation (|2.6|) on the observable past light-cone, and we interchangeably 
use these variables in the following. Therefore, we use the redshift z as an alternative 
spatial coordinate. On a light cone surface, it is also considered as an alternative of the 
time variable, t. 
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In this paper, the light ray is assumed to be transmitted on an unperturbed metric for 
simplicity. This point is discussed later. Then, in redshift space, the angular coordinates 
(9, 4>) are common to those in real space. Only the radial distances are distorted in redshift 
space. Let us consider an object located at comoving coordinates (t, x l ) which has the 
4-velocity u^, normalized as u^u^ = — 1 as usual. In terms of the three-dimensional peculiar 
velocity v l , this 4-velocity is given by 

(1 v*) 
yl - a z v l Vi 

The wave 4-vector, satisfying the null geodesic equations, k^k^ = and k^k u = 0, is 
given by 

P oc (a' 1 , -a~V) , k^ oc (-a" 1 , -nA , (2.8) 

where ri 1 is a three dimensional normal vector, which represents the line of sight, and 
n i — 1ij n ^ ■ The frequencies of the light at the source and at the observer are given 
by v\ = (k^u^lt, and u Q = (k^u^)\ to , respectively. Assuming the peculiar velocities are 
non-relativistic, the redshift z bs the observer actually observes is given by 

1 + ^obs = - = (l + z)(l + W-W ) (2.9) 
vo 

where W = ariiV 1 and Wo = riiV^ are the line-of-sight components of peculiar velocities 
of the source and of the observer. The peculiar velocity W is evaluated on a light cone, 
and Wo can be estimated from the value of the dipole anisotropy of cosmic microwave 
background radiation. 

For convenience, we define the redshift-space physical comoving distance as 
s(z) = x(z ohs ) where z ohs is given by the equation (|2.9|), and the function x(z) is formally 
the same as equation ( |2.4| ) by definition. Explicitly, s(z) is defined by 

f z+(l+z)(W-W ) dz' 

s ^ = L wry < 2 - 10 > 

In other words, the redshift-space physical comoving distance s defined by equation 
( p.lOj ) is the apparent physical comoving distance of an object in redshift space, which is 
originally at redshift z in real space, and is shifted by its own peculiar velocity. In a limit 
^obs — ¥ 0, equation (|2.10|) reduces to the usual relation for nearby universe (Kaiser 1987), 
s = z \ )S /Hq = x + (W — Wo) /Ho- From the redshift-space physical comoving distance s, 
we also define the redshift-space analog of comoving coordinate, Xs as Xs{z) — ^(^obs), or 
equivalently, 

f \K\^s(z), (K*0) 
X ' \s(z). (K = 0) [ ' 
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The difference between the number density of observed objects in real space, 
0, 0, £) and that in redshift space, ?ta s )(x s , 0, 0), are related by the number 
conservation: 

n {s) ( X s, 0, 0) sinh 2 XsdXsdVl = n (r) ( X , 0, 0) sinh 2 xdxdfi, (if < 0) 
n^\xs,9A)x!dxsdQ = n (r) (x, 0, <P) X 2 d X dn, (if = 0) 

n( s \xs, 0, 0) sin 2 X .dx.dn = ™ W (x, 0) sin 2 x<W (K > 0) 

where dVL = sin 9d9d(f>, and is evaluated on a light cone. Therefore, 

/ sinh 2 Xs dxs \ 



(2.12) 



n^( X s,eA) = n (r) (x,o,<P)y< { 



V sinh 2 x <9x 

V X 2 dx J 

( sin 2 Xs d\s \ 
\ sin 2 x 



(if < 0) 
(if = 0) 
(if > 0) 



(2.13) 



The number density in real space is given by the underlying number density of objects p 
multiplied by the selection function $: 

n«( X ,M) = $(x,M)p(x,M) (2.14) 
where we allow the direction dependence of the selection function. 

We assume the linear theory of density fluctuation throughout this paper and we 
only consider the first order in perturbation with respect to the variables, W, Wo, and 
5 = p/p — 1. Then the relation between Xs and x f° r a Axed z, equation (|2.10|) becomes 

l + z 



Xs = X + 



H(z 



<U-U ) 



(2.15) 



where U = |if \ 1/2 W, U = |if \ 1/2 W , for non-flat universe and U = W, U = W , for flat 
universe. With this expansion, the density contrast d>w up to the first order is given by 



P®{Xs,6,< 



1 



Ax) 

aH 



U 



' Ax) 

aH 



Qdec Uq, 



(2.16) 



where 



Ax) 



coshx 
sinh x 

x V 

cosx 
sinx 



2 + 



<91n$ x 
d In sinh \ 



<91n$ 



d In x 



2 + 



«91n$ 
d In sin x 



(if < 0) 
(if = 0) 
(if > 0) 



(2.17) 
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and qdec(z) = —d{aT 1 H~ l )/dX) = 8nGp/ (3H 2 ) and A = A/(3H 2 ) are the normalized 
time-dependent deceleration parameter, the time-dependent density parameter and the 
dimensionless cosmological term, respectively. The parameter q dec is equal to the usual 
time-dependent deceleration parameter fi/2 — A for flat universe, and |f^| -1 / 2 times the 
usual deceleration parameter for non-flat universe. The light-cone effect of density contrast 
in redshift space is represented by this equation (|2.16|) . It is obvious that this equation is a 



generalization of corresponding formula derived by Kaiser (1987) for z —>■ 0. 

In the above equations, the light ray is assumed to be transmitted on an unperturbed 
metric. In reality, the frequency of the light is altered by the Sachs- Wolfe effect (Sachs 
& Wolfe 1967), and the path is bent by the gravitational lensing effect. The Sachs- Wolfe 
effect is the contribution of the potential fluctuations to the estimate of the redshift. The 
potential fluctuations are negligible except on scales comparable to the Hubble distance, 
and in reality, observational determination of the fluctuations on Hubble scales is not easy. 
Therefore, the Sachs- Wolfe effect on the correlation function of density field is not supposed 
to be important in practice. 

The gravitational lensing changes the position on the sky of the observable objects. 
The weak lensing (Kaiser 1992, 1998; Bernardeau, Waerbeke, & Mellier 1997) is relevant 
in our linear analysis. The estimate of the number density is turn out to be affected by 
the local convergence of the gravitational lensing. The local convergence is given by the 
integration of the density fluctuations along the line of sight (Bernardeau et al. 1997), 
and it is efficient for z £ 1. Therefore, it is possible that the gravitational lensing affects 
the correlation function for z ^ 1. In which case, we should add a correction term to the 
equation ( |2.16j ). The quantitative estimate of this effect is beyond the scope of this paper, 



and will be investigated in a future paper. 



2.2. Redshift-space Distortion Operator 

The equations of motion relate the density contrast 5 and the velocity field U. Since 
we intend to include the curvature effect, the Newtonian equations of motion are not 
appropriate. Instead, we employ the perturbed Einstein equation, 

5G» U = 8ttG5T^, (2.18) 

on a background FLRW metric. In order to avoid the inclusion of spurious gauge modes 
in the solution, Bardeen (1980) introduced the gauge-invariant formalism for the above 
perturbed equation (see also Kodama & Sasaki 1984; Abbott & Schaefer 1986; Hwang 
& Vishniac 1990). In Appendix A, we review the gauge- invariant formalism for the 
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pressureless fluid, and derive complete equations to determine the evolution of the density 
contrast and the velocity field. They are given by equations (|A22 )— ( A24 ): 



6 + (A + 3K)ip = 0, (2.19) 
ip + 2Hip + $ = 0, (2.20) 

(A + 3K)<5> = ^H 2 Q5, (2.21) 

where a dot denotes the differentiation with respect to the proper time, d/dt, and A = V*Vj 
is the Laplacian on the 3-metric, 7^ of the FLRW metric, which is explicitly given in 
Appendix B, equation (|B1| ). As shown in Appendix A, the transverse part of the velocity 
field decays with time as a~ 2 and can be neglected, thus the velocity is characterized by the 
velocity potential ip so that the velocity is given by v 1 = VV- The variables 5, ip, and $ in 
the above equations are actually gauge-invariant linear combinations defined in Appendix 
A, and are guaranteed not to have spurious gauge mode in the solution. These variables 
correspond to density contrast, velocity potential, and gravitational potential inside the 
particle horizon. In general, 5 and v correspond to the density contrast and velocity in 
velocity-orthogonal isotropic gauge, V = B, H T = 0, in the notation of Appendix A. It 
is obvious that equations ( |2.19| )-( |2\21| ) correspond to the continuity, Euler, and Poisson 
equations in Newtonian linear theory. The only difference is the appearance of the curvature 
term in the Laplacian. The curvature term would not be important in practice because the 
correlation function on curvature scales is too small to be practically detectable. However, 
we retain the curvature term for theoretical consistency in the following. 

Eliminating the variables ip and $ from the equations, we obtain the evolution equation 
for the Bardeen's gauge-invariant density contrast 5, given by 

6 + 2H5 - ^H 2 Q5 = 0. (2.22) 

This equation is equivalent to that in Newtonian theory for the density contrast, and the 
solution of this equation is well-known (Peebles 1980). The time dependence of the growing 
solution is given by 

In the following, we normalize this growing factor as D(t Q ) = 1, where to is the present 
time. Thus, the growing solution of the equation ( |2.22j ) is given by 

6(x,e,<f>,t) = D(t)8 (x,e,<f>), (2.24) 



where 8q = 5(t = t ) is the mass density contrast at the present time. 
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Equation ( 2.1 9| ) gives the solution of the velocity potential as 

*P = -HDf(A + 3K)- 1 5 , 



(2.25) 



where / = (a/D)dD/da = D/(HD) and H = a/a is the Hubble parameter at time t. The 
inverse operator (A + ?>K)~ l is evaluated by spectral decomposition in the next section. 
It turns out that the function / depends only on Q and A, and is approximately given by 
(Lahav et al. 1991) 



/ = Q - 6 + 



70 



From equation ( |2.25| ), 



d 

W = an l V^ = aHDf—(A + 3K)-%. 

ox 



(2.26) 



(2.27) 



Since d/dx = \K\ l l 2 d / dx for non-flat universe and d/dx = d/dx for flat universe, the 
above equation is equivalent to 



U( X ,e,<f>) = aHDfx 



|X|5 X (A + 3K)-Mo(x,^0), (K^O) 
9 X A-M o (x,^0), (K = 0) 



(2.28) 



where d x = d/dx- 



Equations (|2.16| ) and ( 2.28|) indicate the linear operator which transforms the density 
contrast at present in real space to that in redshift space on a light-cone. That is, we can 
define the redshift distortion operator: 



R = l + (3x 



\K\ (d x + a) d x {A + 3K)-\ (K ^ 0) 



a)d x A-\ 



(K = 0) 



(2.29) 



where 



«(x) 



cosh X / + dln(Df*) \ 

sinh x V ® l n s i nn X J 
d\n(Df$)\ 



2 + 



X \ 
cosx 

sinx 



d\nx J ' 
d\n(Df$) \ 

d In sin x J 



{K < 0) 
(K = 0) 
(K > 0) 



(2.30) 



The time-dependent redshift distortion parameter is defined by (3(z) = f(z)/b(z), where 
b(z) is the time-dependent bias parameter. In the following, we present the result in the case 
that there is neither stochasticity nor scale-dependence in the biasing. It is straightforward 
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to include the scale-dependence and stochasticity, although the expression becomes more 
tedious. In linear regime, however, the stochasticity is shown to asymptotically vanish on 
large scales and biasing is scale-independent beyond the scale of galaxy formation, except 
some special cases (Matsubara 1999). 

For the surveys of nearby universe, z<l, the functions D and / do not vary as rapidly 
as the selection function, <3>, and the factor Df in the above equations can be omitted, as 
is done in the literatures. However, if the selection function varies as slowly as the factor 
Df, the latter factor cannot be neglected. With the redshift distortion operator, we can 
re-express the density contrast in redshift space as 

* (s) (s,M) = bDR8 Q {x,e,<j)) + (j^Mx) ~ <Zdec(*)) U . (2.31) 

This expression depends on a peculiar motion of observer, Uq, which somewhat complicate 
the analysis. Since we know the value Uq by measuring the dipole anisotropy of the CMB 
radiation (Kogut et al. 1993; Lineweaver et al. 1996), we can subtract the term which 
depends on Uq from the above expression. In the following we derive the correlation function 
in redshift space from the observer in the CMB frame and drop the Uq term. In proper 
comparison of our result below and the observation, one should be sure that the correlation 
function is corrected by such kind of transformation to the CMB frame (Hamilton 1998). 

The correlation function in redshift space of two points, Xx, x 2 is thus given by 

^ s \ Xl , x 2 ) = b 1 b 2 D 1 D 2 R 1 R^( X )- (2-32) 

where b\ = b(z{), b 2 = b(z 2 ), D\ = D(zi), D 2 = D(z 2 ), and zi, z 2 are redshifts of the 
two points, and £(x) is the mass correlation function in real space at present time. The 
redshift distortion operators R\ and R 2 operate the density contrast at points X\ and x 2 , 
respectively, and \ is a comoving separation of the two points. If we do not omit the local 
velocity term, U , the square of the second term in equation (|2.31|) is added to the equation 



( p.32j ). In the following, we obtain an explicit expression for equation ( [2.32; ). 



3. THE CORRELATION FUNCTION IN REDSHIFT SPACE IN 
FRIEDMAN-LEMAiTRE UNIVERSES 



In this section, we derive the explicit expression for the correlation function in redshift 
space. We separately consider an open universe, a flat universe and a closed universe in the 
following subsections. 
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3.1. An Open Universe 

In an open universe (K < 0), the correlation function in real space is given by equation 
(§53): 

fo)= f^-MwWv), (3.1) 



2n 2 



where 



X a = = (3.2) 
z/ sinh x 

and 5*(z/) is the power spectrum of the gauge-invariant density contrast (see Appendix B 
for detail)^. In this subsection, we omit the superscript (— ) of Xi, which distinguish the 
difference of functional forms according to the sign of curvature in Appendix B. Equation 
( j2.32| ) implies that we only need to calculate RiR^X^v, x) to obtain the formula for 
correlation function in redshift space. Since the Laplacian is the invariant operator under 
transformation of the coordinate system, the inverse operation (A x + 37TT 1 , (A 2 + 3K)' 1 
to X is simply given by (— q 2 + 3K)~ 1 X = — \K\~ l (v 2 + 4) _1 X , where q is defined by 
equation (|B6p, because X is the fundamental eigenfunction of the Laplacian [Appendix B, 
equation (|B^)j. 

The calculationally nontrivial part of the redshift-space distortion operator is the 
spatial derivatives along the lines of sight, d x , which is not invariant operation, unlike 
the Laplacian. We illustrate in the rest of this subsection how the calculation can be 
accomplished. The comoving separation x between xi and X2 is related to the comoving 
distances Xi an d Xi °f these two points from the observer and the angle, 9 between the 
lines of sight of these points with respect to the observer (Figure [1]), through the standard 
relation: 

cosh x = cosh xi cosh Xi ~ sinh Xi sinh Xi cos 6. (3.3) 
The derivatives of this equation yield 
dx 1 



dxi sinh x 
dx = 1 
8x2 sinh x 



(sinh xi cosh X2 — cosh Xi sinh X2 cos 9) = cos 71, (3.4) 
(cosh xi sinh X2 — sinh xi cosh X2 cos 6) = cos 72, (3.5) 



2 Note that the power spectrum near the horizon scale depends on the gauge choice. The power spectrum 
S(u) is defined by Bardeen's gauge-invariant density contrast, i.e., the density contrast in a gauge with 
velocity-orthogonal slicing, V = B. 
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where 71 is an angle between the geodesies of Xi an d X-, an d 72 is an angle between the 
geodesies of X2 and X (Figure [I]). The following equations are useful for our purpose: 



d 

dxi 
d 

9x2 



(sinh x cos 71) = coshx, 

(sinh x cos 71) = — cosh x cos 9, 



where 



~ sin 7x sin 72 cosh Xi cosh X2 cos 9 — sinh Xi sinh X2 

cos 9 = ; cos 71 cos 72 



cosh x 



cosh xi cosh X2 — sinh Xi sinh X2 cos 9 



(3.6) 
(3.7) 

(3.8) 



One can prove | cos#| < 1 with this definition and 9 —>■ 9 for the scale much less than the 
curvature scale, x ^ l-^l~ 2 - We also use the derivatives of the radial part of the harmonic 
function Xi(u,x), given by equation ( |B13| ), and the recursion relation, given by equation 
( |B16| ). The explicit form of the radial part of the harmonic function Xi is presented in 
Appendix B, equations QB19|) - ([B23| ). 



After straightforward but somewhat tedious algebra, using equations 
and ( |B16| ), one obtains the spatial derivatives along the lines of sight as 



dXo 

dxi 
d 2 X _ 

dx? 
d 2 X 

dxidx2 
d*X 

dxidx2 



d*X 
dxidxi 



COS71X1, 



X -l(u 2 + A)X + (cos 2 71 



1 



X, 



cos 9X + - cos 9{y + 4)X + I cos 71 cos 72 + - cos 9 I X 2 



cos 72 Xi + - (2 cos 71 cos 9 — cos 72) {y 2 + 4)Xi 



i-(gD, (plan 

(3.9) 
(3.10) 
(3.11) 



+ - [2 cos 71 cos 9 + 5 cos 71 cos 72 — cos 72 J X 3 , 

X - — (4 + 3 cos 2 9) {v 2 + 4)A + — (l + 2 cos 2 9) (u 2 + 4) 2 A ( 



(3.12) 



21 
1 

+ 2l 



4 — 6 cos 2 9 — 27 (cos 2 71 + cos 2 72) — 60 cos 71 cos 72 cos 9 



X, 



+ 



35 



2 + 4 cos 2 9 — 3 (cos 2 71 + cos 2 72) + 12 cos 71 cos 72 cos 9 [y 2 + 4)X 2 
1 + 2 cos 2 9 — 5 (cos 2 71 + cos 2 72) +20 cos 71 cos 72 cos 9 



+ 35 cos 2 71 cos 2 72 



X d . 



(3.13) 



13 



Thus, RiR 2 X (v>, x) is expanded as follows: 



sinh 2n -'x(^ 2 + 4) n: 



(3.14) 



where (n,l) = (0,0), (1,0), (1,1), (1,2), (2,0), (2,1), (2,2), (2,3), (2,4), and coefficients 
c\ are given by 



where 



.(0) 



4" 



4" 



.(2) 



.(2) 



.(2) 



i + -(A + AO + ^Pifo (i + 2 cos 2 e) 

/?i + /9 2 + ^i/5 2 (4 + 3cos^ 



sinh 2 x PiP 2 a 1 a 2 cos 9, 



Piai COS71 + (3 2 a 2 cos 72 

+ — /5i/?2 5i (cos 71 — 2 cos 72 cos + <5 2 (cos 72 — 2 cos 71 cos (P) 



Pi (cOS 2 Tl-g) +P2 



2 COS 72 



— I — COS 
3 3 



9 — (cos 2 71 + cos 2 72) + 4 cos 71 cos 72 cos 9 

Pif3 2 (sinh 2 x - 5i5 2 ) sinh 2 x, 
P1P2 (Si COS71 + 5 2 cos 72) sinh 2 x, 

9 1 — [cos 2 7x + cos 2 72 J + 10 cos 71 cos 72 cos 9 



(3.15) 
(3.16) 

(3.17) 

(3.18) 

(3.19) 
(3.20) 



cos 



sinh 2 x 



+ fi\fiia.\ot,2 |^cos 71 cos 72 + - cos 9 

-P1P2 5i (5 cos 7x cos 2 72 — cos 71 + 2 cos 72 cos 9j 

+ Ot 2 (5 cos 72 cos 2 71 — cos 72 + 2 cos 71 COS 9j 



COS 



9 — (cos 2 71 + cos 2 72) + 4 cos 71 cos 72 cos 9 



+ 7 cos 2 71 cos 2 72 



ai(Xi,x) = tt(Xi)sinhx = sinhx 



cosh xi 
sinh Xi 



"2(X2,x) = «(X2)sinhx = sinhx ^j^ 



2 + 
2 + 



9 In sinh Xi 
01n(£ 2 / 2 $ 2 ) 
9 In sinh X2 



(3.21) 
(3.22) 
(3.23) 

(3.24) 
(3.25) 



and p 1 = P{ Zl ), (3 2 = P(z 2 ), f x = f( Zl ), f 2 = f(z 2 ), $1 = $(xi), $2 = $(x 2 ). Since these 
coefficients do not depend on v, the correlation function in redshift space of equation fl2.32j ) 
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finally reduces to 



axi,x 2 ) =b 1 b 2 D 1 D 2 Y,4 n \xi,X2,9)Z < i l \x), (3-26) 

n,i 



where 



smh 2n ~ l x' 2vr 2 (z/ 2 + 4) 



r ) (x) = ^-/^7^™^). (3.27) 



In the left panel of Figure 0, some examples of the function 5j i(x) 101 an open model 
are plotted. The CDM-type transfer function (Bardeen et al. 1986) is adopted and the 
primordial power spectrum on large scales is assumed to be "scale invariant", which 
corresponds to constant fluctuations in the gravitational potential per logarithmic interval 
in wavenumber (Lyth & Stewart 1990; Ratra & Peebles 1994; White & Bunn 1995): 

*M « ^rf 2 (l^ v Vr) , (3.28) 

where 

= ln(l + 2.34p) r + g + ^ 2 + 46 3 + 4 i -i/4 

2.34p L J 

and the shape parameter is set T / (/i _1 Mpc = 0.2), which corresponds to V = 6x 10 2 (cif ~ 1 ) 1 
in our unit system. On scales smaller than Horizon scale, y> 1, the power spectrum ( p. 28; ) 
reduces to usual CDM-type power spectrum with Harrison-Zel'dovich primordial spectrum. 



The set of equations ( |3.15| )- (|3.27|) is our final formula for the correlation function in 



redshift space which takes into account the light-cone, and spatial-curvature effect without 
distant-observer approximation. 



3.2. A Flat Universe 

In a flat universe (K = 0), the correlation function is real space is given by equation 



where 



(M = I ^rM», X>S(v), (3.30) 



X = 55i* (3.31) 
vx 
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We can repeat the similar calculation of the previous subsection for a flat universe (K = 0). 
The corresponding formula can also be used if we only consider a nearby universe where the 
separation x an d the distances xx-> X2 are much smaller than the curvature scale, |i^| _1//2 , 
which roughly corresponds to the horizon scale. 

The calculation for a flat universe is performed similarly as in the previous subsection, 
or alternatively, we can also obtain the formula in a flat limit from the formula for an open 
universe, taking the limit Xi-> X2, X ~ * 0, v — > 00, with vx fixed. Anyway, the equation (|3.3|) 
reduces to the one in Euclidean geometry: 



X 2 = Xi + xl - 2%iX2 cos 9. 
The meaning of 71 and 72 is the same, and they are explicitly given by 



COS71 



xi - X2 cose 

X 



cos 72 



X2 - XicosO 
X 



(3.32) 



(3.33) 



The variable 9 in flat universe, defined by equation (|3.8|) for the case of an open universe, 
reduces to 9, the angle between lines of sight of x\ and x 2 with respect to the observer. 

Thus, the correlation function in redshift space is given by equation (|3.26|) where the 
coefficients c| n ' ) in a flat universe are 



c (0) 

c 



cp = COS71 + (3 2 a 2 cos 72 



1 + ^0 + fa) + ^Pifc (l + 2 cos 2 9) , 
--/3i/3 2 5 1 5 2 cos9, 



+ -=ftiP2 [«i (cos7i — 2 cos 72 cos 9) + a 2 (cos 72 — 2 cos 71 cos^)] , 





c (1) 

c 2 



r (2) 
r (2) 

c (2) 

c 2 



.(2) 



.(2) 



fix [cos 2 71 - + /3 2 (cos 2 72 - 



2 4/ \ 

— I — cos 2 9 — [cos 2 71 + cos 2 72 J + 4 cos 71 cos 72 cos 9 



0. 
0. 



f3if3 2 aia2 ( cos 71 cos 72 + - cos 9 



-P1P2 on (5 cos 71 cos 2 72 — cos 71 + 2 cos 72 cos 9^j 
+ a 2 (5 cos 72 cos 2 71 — cos 72 + 2 cos 71 cos 9 



(3.34) 
(3.35) 

(3.36) 

(3.37) 

(3.38) 
(3.39) 

(3.40) 
(3.41) 



P1P2 



H — cos 2 9 — (cos 2 71 + cos 2 72) + 4 cos 71 cos 72 cos 9 
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+ 7 cos 2 7x cos 2 72 



(3.42) 



where 



5i(Xi> x) = «(Xi)x = — f 2 + 

Xi V 

"2(X2, x) = a(x 2 )x = — 2 + 



X2 



(9 In xi 
<9m(P 2 / 2 3> 2 ) 
(9 In x 2 



(3.43) 
(3.44) 



The corresponding equation of (|3.27|) is 



s, w (x) 



X 



2 n-« 



27T 1/ 



2ri 



5(1/) 



-1 



;r 



2n- 



k 2 dk ji(kx) 
2tt 2 P™ - ' 



P(fc). (3.45) 



In the middle panel of Figure some examples of the function s| n ^ (%) for a flat model are 
plotted for scale invariant primordial power spectrum with CDM-type transfer function: 



(3.46) 



S(u) oc z/T 2 (z//r), 

where we again set the shape parameter r/(/i _1 Mpc) = 0.2. 

Alternatively, the coefficients c\ can also be represented by using variables 7 = 7 2 + 9 
and 6^ = 6/2. These variables are introduced in Szalay, Matsubara & Landy (1998) in 
a calculation of wide-angle effects of nearby universe (z <C 1), except that their original 
definition of 7 is tc — 7, instead. The meaning of 7 is the angle between x 2 — x\ and a 
symmetry axis that halves the angle 9. 



With these new variables, equations (|3.34j) - (|3.42|) are transformed as 



c (1) 

c 



Jl) 



JX) 

c 2 



1 + o (A + ft) + -/?i/? 2 - t^iAs cos 2 9 h sin 2 



15' 



--/?i/5 2 aia 2 cos 29 h , 



(fliai + P 2 a 2 ) + -PifhioLi + a 2 ) (3-4 cos 2 9\ 

n v 



(/3i5i - /5 2 a 2 ) + — /?i/?2 ("l - "2) (3-4 sin 2 9 h 



sin #h sin 7 

cos #h cos 7, 



(3.47) 
(3.48) 

(3.49) 



cos 2^ h P 2 (cos7) 



(/3i+/5 2 )--/5 1 /5 2 + -/3 1 /5 2 sin 2 ^ 



7 



7" 



sin 2 



2 (Pi — p 2 ) cos 9 h sin # h cos 7 sin 7 , 



c (2) 



(3.50) 
(3.51) 
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c? = 0, 

= -/3i/3 2 ai<5 2 (sin 2 9 h - 2P 2 (cos7) 

cos 2 #h Pi (sin 7) — 2P 3 (sin7) 



(2) 
C 2 



of = ^ 



where Pi(x) is the Legendre function 



(3.52) 
(3.53) 



— (a 1 — a> 2 ) cos^h sin 2 # h P 1 (cos7) — 2P 3 (cos7) |, (3.54) 

8 4 1 

-P 4 (cos7) - - sin 2 # h P 2 (cos7) - — (4 - 9 sin 2 9 h ) sin 2 9 h 
5 3 15 



, (3.55) 



3.3. A Closed Universe 



In a closed universe (K > 0), the correlation function in real space is given by the 
equation (|B52j ): 



00 u 2 



u=3 



where 



sm ux 



(3.56) 



(3.57) 



usmx 

Repeating the similar calculation as in an open universe, or formally putting \ ~^ i>Xi 
Xi ~ * iXii X2 iX2 and v — > —iv in the calculation for an open universe, we obtain the 
formula for a closed universe. In this subsection, we just summarize the difference of the 
formula from the case of an open universe. 



(3.58) 



The corresponding equation (|3.3| ) in a closed universe is 

cos x = cos Xi cos X2 + sin xi sin \2 cos 9, 
The meaning of 71 and 7 2 is unchanged and they are given by 



COS71 



(sm xi cos X2 — cos Xi sm X2 cos 1 



smx 

cos 7 2 = (cos xi sin X2 — sin xi cos % 2 cos 1 

smx 



The variable 9 in a closed universe is defined by 



~ sin 71 sm 72 

cos 9 = cos 71 cos 7 2 

cos x 



cos Xi cos X2 cos 9 + sin xi sin X2 
cos xi cos X2 + sin xi sin X2 cos 9 



(3.59) 
(3.60) 

(3.61) 
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Then the form of the coefficients q of equation ( 3.15|) - (|3.23|) is almost the same, and we 
do not repeat the formula here. The only difference is that sinhx should be replaced by 
sinx, and the definition of a is changed as 

5i(Xi,x) = "(Xi) sinx = sinx C ° SXl [2 + d ^ L>1 ^ 1 ) ; (3.62) 

smxi y amsmxi J 

"21X2, X) = a(X2j smx = sin^- 2 + — — : . (3.63) 

smx2 V din sin X2 / 

The formula for a closed universe is also given by the equation ( |3.26| ) where the definition 
of E\ is replaced by 

^(n) ( \ 1 ^ V 2 Xl(u,x) Q , , /o ca\ 

- (X) = ■ 2n-f L — . (3.64) 

sin x ^3 27r^ (z/ z — 4J n 

In the right panel of Figure |], some examples of the function (x) are plotted for a closed 
model. As in the open case, the primordial power spectrum on large scales is assumed to be 
"scale invariant" , which corresponds to constant fluctuations in the gravitational potential 
per logarithmic interval in wavenumber (White & Scott 1996): 

S(u) oc ( ^ ~ 4 j 2 T 2 (\K\V 2 u/r) . (3.65) 



u(u 2 - 1 

where we again set the shape parameter as r/(/?,~ 1 Mpc) = 0.2 



3.4. Recovery of the Known Formulas of the Redshift Distortions of the 

Correlation Function 

It is an easy exercise to derive the previously known formulas of the redshift distortions 
of the correlation function from our general formula. We illustrate how our formula reduces 
to the known formulas by taking appropriate limits. Here we consider two approximations, 
X ^ Xi)X2 and/or z<l. The first approximation corresponds to the distant observer 
approximation. In this approximation, the distance between two points is much smaller 
than the distances of these points from the observer. The second approximation corresponds 
to only considering the nearby universe. The redshift distortion formulas known so far are 
restricted in these cases. 

First of all, consider a limit x <C Xi>X2> with 71, 72 fixed. We also set (3\ — (3% — P, 
and the distance between the two points x is much smaller than the curvature scale. Then 
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irrespective to the spatial curvature, 9, 6 — > 0, and 72 — > tt — 71 = 7. Both the coefficients 
(P15|)-(CT), and (ggg)-(ggg) reduce to 



4 0) = 1 + ~/3 + > (3.66) 
3 5 

4 1} = (^+^ 2 )p 2 (cos 7 ), (3.67) 

cf = ^/3 2 P 4 (cos 7 ), (3.68) 
35 

and all the other coefficients are zero. These coefficients are equivalent to the result that 
Hamilton (1992) derived in z — > limit with distant observer approximation, which is a 
direct Fourier transform of Kaiser's original form in Fourier space (Kaiser 1987). For finite 
z, the equivalent result is obtained by Matsubara & Suto (1996) for correlation function and 
Ballinger, Peacock & Heavens (1996) for power spectrum [see also Nakamura, Matsubara & 
Suto (1998) de Laix & Starkman (1998), Nair (1999)]. All these previous studies are based 
on the distant observer approximation, and our general formula correctly has the limit of 
these cases. 

The wide-angle effects on the redshift distortion of the correlation function without 
distant observer approximation is already derived for nearby universe, z <C by Szalay, 
Matsubara & Landy (1998), and Bharadwaj (1999) also derived the equivalent result with 
another parameterization. It is easy to see that our general results have the correct limit 
of Szalay et al. (1998). In the limit z — > the geometry reduces to be flat case, and, in 
fact, equations ( |3.47|) - (|3.55|) with (5\ = (3 2 = (3 in that limit is completely equivalent to the 
result of Szalay et al. (1998) after correcting their typographical errors^, noting the minor 
difference of the definition that 7 and Ej here correspond to 71 — 7 and (— l) n+l x~ 2n+l ^[ 2n ^ 
in Szalay et al. (1998), respectively. 



4. THE REDSHIFT DISTORTIONS AND THE SPATIAL CURVATURE OF 

THE UNIVERSE 

It is well known that the redshift distortions of the correlation function for nearby 
universe are good probes of the density parameter modulo bias factor at present time, 
/3q = f2g' 6 /6o- The parameter (3q is called as the redshift distortion parameter of nearby 
universe. Redshift distortions of nearby universe do not depend on spatial curvature almost 



3 The factor 4/15 in the last term of their equation (15) should be replaced by 8/15 and the left hand side 
of their equation (20) should be replaced by 1/3 • cos 29. 
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at all, because the redshift distortions of nearby universe are purely caused by the peculiar 
velocity field, which is almost independent on the spatial curvature. However, the redshift 
distortions at high redshifts, say z £ 1 in a quasar catalog, definitely depend on the spatial 
curvature of the universe and is called as cosmological redshift distortion. Matsubara & 
Suto (1996) explicitly show the dependence of the cosmological distortion of the correlation 
function on cosmological parameters, employing the distant observer approximation. To 
probe more properly the spatial curvature with cosmological distortions, it is not desirable 
to rely on the distant observer approximation. 

In this section, we numerically calculate the formula obtained in the previous section 
for several models, concentrating on geometrical effects. We plot the correlation function 
in directly observable velocity space. In the following, the shape parameter for the 
CDM-type transfer function is fixed to T = 6 x 10 2 in our unit system, which corresponds 
to r/O^Mpc) = 0.2, in spite of the fact that CDM model predict r/(fc _1 Mpc) = tt h. 
We fix the spectrum simply because we are interested in the pure distortion effects on the 
difference among the models, while the difference of the shape of the underlying power 
spectrum is less interested in here. The primordial spectrum is assumed to be "scale 
invariant", which corresponds to constant fluctuations in the gravitational potential per 
logarithmic interval in wavenumber, equations ( |3.28| ), ( |3.46| ) and ( |3.65| ). For simplicity, 
we assume no bias, b = 1 and also assume a = 0. The latter assumption corresponds 
to the case Df&(x) ^ (sinhx) -2 ; X~ 2 > an d (sinx) -2 , for open, flat, and closed models, 
respectively. Although this form of selection function is not physically motivated, it is not 
so unrealistic for merely illustrative purpose. In actual application, the selection function is 
individually determined for each redshift survey. 

Figures Q-|6| show the contour plots of the correlation function. Each figure 
consists of 12 panels. In each figure, from top to bottom, the cosmological models are 
(Q ,A ) = (1,0), (0.2,0.8), (0.2,0), respectively, which we call STD, FLAT, and OPEN 
models. From left to right, the redshifts of the first points are z = 0.1,0.3,1.0,3.0, 
respectively. 

In Figures [3] and ^, the correlation function with the purely geometrical distortions 
is plotted for an illustrative purpose, assuming there are no peculiar velocities at all, by 
setting (3 = in our formula. The first point, X\ of equation ( |3.26| ), is at the center on the 
y-axis in each figures. The contour plot show the value of correlation function depending on 
the position of the second point x 2 . In Figure |3], the observer is located at the origin (0, 0) 
and the global distortions are shown. In Figure |J the scale of z around the first object is 
fixed, and the observer is located at (0, —Zi), outside the plots. 

For lower redshifts, z = 0.1, 0.3, the geometrical distortion is not significant. For higher 
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redshifts, z = 1.0, 3.0, due to the nonlinear relations of redshift and comoving distance, the 
contours are elongated to the direction of line of sight in all three models. The extent of the 
elongation for STD and OPEN models are similar, but the elongation for FLAT model is 
smaller than other models. This is because the acceleration nature due to the cosmological 
constant squashes the z-space along the line of sight (Alcock Sz Paczyhski 1979). 

In Figures ^ and |6], the correlation function in redshift space is plotted, taking into 
account the velocity distortions. As in Figures | and f|, the observer is located (0, 0) and 
(0, — z\), respectively. 

For lower redshifts, the redshift distortions are mainly from peculiar velocity fields, 
which depends only on the density parameter Q . Thus, STD model can be discriminated 
from other models by correlation function of lower redshifts, but FLAT and OPEN models 
are similar. For higher redshifts, FLAT and OPEN models become different because of the 
squashing by the cosmological constant. 

To illustrate the difference among profiles of correlation function in redshift space for 
different models and different redshifts, we define the parallel correlation function 
and perpendicular correlation function £±(z±; z) at given z. In terms of the correlation 
function in redshift space ^ s '(zi, z 2 , 9) they are defined by 



The geometrical meaning of the definition of the parallel redshift interval z» and the 
perpendicular redshift interval z± are illustrated in Figure [7|. As seen from the Figure |5] or 
H these sections of correlation function are supposed to be maximally distorted in opposite 
direction, and that is the reason why we introduce them for illustrations. These functions 
are the generalization of the similar functions introduced by Matsubara & Suto (1996) in 
the case of distant observer approximation. 

In Figure || those parallel and perpendicular correlation functions are plotted for STD, 
FLAT, and OPEN models. The correlation function in real space is normalized as erg = 1. 
One can notice that while the perpendicular correlation functions are not significantly 
different among three models, the parallel correlation functions are quite different. For 
lower redshifts, profiles of the parallel correlation function for the FLAT and OPEN models 
are similar as usual. For higher redshifts, the relative amplitude of £n compared to £j_ in the 
OPEN model is higher than that in the FLAT model. In addition to that, the zero-crossing 
point of £|| in the OPEN model is larger than that in the FLAT model. Those tendencies 
are both explained by the cosmological-constant squashing, because the squashing shifts 




(4.1) 



(4.2) 
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the profile toward small scales, or left. Even if the determination of the zero-crossing point 
of £|| is observationally difficult, the former effect on the relative amplitude is a promising 
one to discriminate the spatial curvature by the observation of redshift distortions. 

The distant observer approximation has been widely used in the analyses of galaxy 
redshift surveys. With our general formula, we can figure out when this approximation is 
valid and when it is not. The distant observer approximation of the two-point correlation 
function is derived by Hamilton (1992) for a nearby universe, z <C 1. Matsubara & 
Suto (1996) generalize his formula to arbitrary redshifts, in which the distant observer 
approximation is still adopted. In Figure |, we plot the ratio of the value of those two 
previous formulas and that of our formula. We choose the geometry of the two points 
as follows: we fix the separation z 12 = (zf + z 2 2 — 2z%z 2 cos#) 1//2 of the two points in 
velocity space. The angle j z between the symmetric line which halves the lines of sight 
and the line between the two points is also fixed. The meaning of the angle j z is the 
inclination of z\i relative to the line of sight in velocity space. Explicitly, 7 Z is given by 
tan 7 2 = {z\ + z 2 )\zi — z 2 \~ l tan(#/2). The angle 9 between the lines of sight is varied in the 
figure. We plot the cases, z l2 = 0.003, 0.006, 0.012, 0.024, and 7, = 10°, 45°, 80°. There is 
some irregular behavior that corresponds to the zero crossings of the correlation function. 

The Hamilton's formula (thin lines) is valid when the separation z± 2 is not so large. 
The reason why the Hamilton's formula deviate even in small angles is that when the angle 
is small enough, the redshift becomes large, and the evolutionary and geometrical effects are 
not negligible. In fact, the formula of Matsubara & Suto (thick lines) is perfectly identical 
to our general formula when the angle is small. 

The validity region of the distant observer approximation depends on the inclination 
angle j z . However, one can conservatively estimate the validity region as 9 ^ 10°. One can 
use 9 ~ 20° for some cases, while the blind application of the approximation for 9 ~ 30° can 
cause over 100% error. 

5. CONCLUSIONS 

In this paper we have derived for the first time the unified formula of the correlation 
function in redshift space in linear theory, which simultaneously includes wide-angle effects 
and the cosmological redshift distortions. The effects of the spatial curvature both on 
geometry and on fluctuation spectrum are properly taken into account, and our formula 
applies to an arbitrary Friedman-Lemaitre universe. 

The distant observer approximation by Matsubara & Suto (1996), which is a 
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generalization of the work by Hamilton (1992), can be used when the angle 9 between the 
lines of sight is less than 10°. Beyond that range, our formula provides a unique one for the 
correlation function in redshift space with geometrical distortions. 

The correlation function in redshift space is uniquely determined if the cosmological 
parameters fl , A , the power spectrum P{k) and bias evolution b(z) is specified. The 
Hubble constant does not affect the correlation function, provided that we do not adopt a 
specific model to the power spectrum and/or to the bias evolution which may depend on 
Hubble constant. Our formula predicts the correlation function for a fixed model of these 
variables and one can test any model by directly comparing the correlation function of the 
data and of the theoretical prediction in redshift space. 

Now we comment on some caveats for our formula. First, when we try to apply our 
formula to the scale £ 20/i~ 1 Mpc, what apparently lacks in our formula is the finger-of-God 
effect, or the nonlinear smearing of the correlation along the line of sight. While it is still 
difficult to analytically include this effect into our formula, one can phenomenologically 
evaluate the effect by numerically smearing the formula along the line of sight. Second, our 
formula does not include the Sachs- Wolfe and gravitational lensing effects. The Sachs- Wolfe 
effect could affect our formula only on scales comparable to Hubble distance where the 



correlation function is too small to be practically detectable, as discussed in section |2J . 
However, it is possible that the gravitational lensing effect affects the observable correlation 
function for z £ 1. In which case, one should add correction terms to our formula. Even 
so, our formula for z ;$ 1 would not be affected by those terms and still corresponds to 
the observable quantity. Those correction terms by gravitational lensing will be given in a 
future paper. Third, our formula assumes the selection function uncorrelated to the density 
fluctuations. In addition, the precise form of the selection function is practically difficult 
to determine. If the luminocities and/or the surface brightnesses are correlated to density 
fluctuations, it can mimick the large-scale structure. 

It could be the case that one can blindly seek the models of cosmological quantities, 
Qo, Xq, P{k), and b(z). Each quantity has different effects on the correlation function in 
redshift space. Roughly speaking, the cosmological parameters fl and A mostly affect 
the distortions of the contour of the correlation function, the power spectrum P(k) mostly 
affects the profile of the correlation function, and the bias evolution mostly affects the 
z-dependence of the amplitude. Since all the pairs of the objects in the redshift survey can 
be used, we can expect that those quantities are determined with small errors by performing 
proper likelihood analysis, such as the Karhunen-Loeve mode decomposition (Vogeley & 
Szalay 1996; Matsubara, Szalay & Landy 1999). The application of the formula to the 
actual data is a straightforward task. We believe the formula presented in this paper is one 
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of the most fundamental theoretical tools in understanding the data of the deep redshift 
surveys. 

I wish to thank Alex Szalay, Naoshi Sugiyama and Yasushi Suto for stimulating 
discussions. This work was supported by JSPS Postdoctoral Fellowships for Research 
Abroad. 
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APPENDIX A 

GAUGE-INVARIANT EVOLUTION EQUATIONS FOR THE DENSITY 
CONTRAST AND THE VELOCITY FIELD 

In this appendix, we review the derivation of the equations of motion for the density 
contrast and the velocity field in the general relativistic context. We assume the matter is 
pressureless, perfect fluid, and the background metric is given by homogeneous, isotropic 
FLRW metric. For the perturbed Einstein equation, 

SG^ = 8nG5T^, (Al) 

Bardeen (1980) introduced the gauge- invariant formalism. Here, we briefly review the 
formalism in the case of pressureless fluid, and derive relevant equations for our purpose, 
i.e., equations to relate the density contrast and the velocity field. In this appendix, we use 
the conformal time r defined by dr = dt/a, so that the metric is given by 

ds 2 = a 2 (r) (-dr 2 + j^dx^dx^ , (A2) 

in the coordinates (r, x % ). A prime denotes differentiation with respect to the conformal 
time. 

The perturbations are classified into scalar, vector, and tensor types. The scalar 
perturbations are expanded by the complete set of scalar harmonics Q{x % ) satisfying the 
Helmholtz equation 

(A + g 2 )Q = 0, (A3) 

where A = V*Vj is the Laplacian and V< is the three-dimensional covariant derivative 
with respect to the metric 7^. The explicit form of each mode of this solution is given in 
Appendix B. In the following, the indices to distinguish different modes are omitted and 
each mode function is represented by Q. 

For each mode, the scalar perturbations in the metric ( |A2| ) are defined by 

h 00 = -2cl 2 A(t)Q, (A4) 
h 0l = -a 2 B(r)Q h (A5) 
hij = 2a 2 [H L (r)Qjij + H T (r)Q l3 ] , (A6) 



where 



Qi = --ViQ, (A7) 
Q 

Qij = ^V^Vj-g + -jijQ. (A8) 
q z 3 
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The three-velocity w l associated with four-velocity VtF" is represented by 



u 



w* = - = V{t)Q\ (A9) 
and to first order the normalization u^u^ = — 1 gives 



„• = l - A{T)Q . (AID) 
a 

The pressureless energy- momentum tensor is given by T^ v = pu^u u , thus, the scalar 
perturbations in the pressureless energy-momentum tensor are 

5T° = -pA(r)Q, (All) 
ffZ* = p[V(r) - B(r)]Q 3} (A12) 
= 0. (A13) 

In terms of the gauge-dependent variables A, B, Hl, Ht, V, and A, Bardeen (1980) defined 
gauge invariant combinations: 

$ A = A + -B' + --B - \ ( H T " + -hA , (A14) 
q q a q z \ a I 



§h = H l + \h t + ~-B - \-H T ', (A15) 
3 q a q z a 

3 a' 



5 = A + (V-B), (A16) 

q a 

V, = V- ~H T '. (A17) 

The perturbation equation ( |A1| ) for these scalar gauge-invariant variables are given by 
Bardeen (1980): 

(q 2 - 3K)$ H = AirGa 2 p8, (A18) 

$a + ®h = 0, (A19) 

VJ + -V. = g$A, (A20) 
a 

5' + (q 2 -3K)-V S = 0. (A21) 

q 

We define new variables if) = — a -1 ? -1 ^ and $ = a~ 2 $ A . After superposing the modes of 
the above equations, we obtain 

5 + (A + 3K)ip = 0, (A22) 

ip + 2Hip + $ = 0, (A23) 

(A + 3K)<5> = ^H 2 Q5, (A24) 



-27- 



where a dot denotes the differentiation with respect to the proper time, d/dt, and A is the 
Laplacian on FLRW metric, equation ( |B1| ), This is the complete set of equations to treat 
the scalar perturbations. 



The velocity w % corresponds to dx l /dr = adx l /dt = av l , and the equation (|A9|) suggests 
w l = aVY, so that v i = V 1 ^, i.e., ip is the velocity potential and represents the longitudinal 
part of the velocity v l . The transverse part of v i belongs to the vector perturbations. 

The vector perturbations are expanded by the divergenceless vector harmonics 
satisfying 



(A + g 2 )QS 1} = 
V*Qf ] = 0. 

For each mode, the vector perturbations are given by 

0. 



0. 



hoi 



-a 



(i) 



hij = 2a 2 H^(T)Q 



ij j 



where 



The vector perturbations in the three-velocity are 



(i) 



(A25) 
(A26) 



(A27) 
(A28) 
(A29) 



(A30) 



w 



and in the energy momentum tensor are 



ST" 
6T C 
67* 



fiyV(T)-BV(T)]Q jt 



0. 



For vector perturbations, Bardeen (1980) defined the gauge-invariant combinations: 



Q 



T 5 



V r = vV)-B<». 



(A31) 



(A32) 
(A33) 
(A34) 



(A35) 
(A36) 
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The perturbation equation (ST) for these vector gauge-invariant variables are given by 
Bardeen (1980): 

(q 2 - 2K)ty = 167rGa 2 pV c , (A37) 
V c ' + —V c = 0. (A38) 

(X 

We define a new variable = a~ 1 V c , which is the transverse part of the velocity v % . After 
superposing the modes of the equation ( |A38|) , we obtain 

4 + 2#4 = 0, (A39) 
Vi4 = 0. (A40) 

Since the density contrast and the velocity field are irrelevant to the tensor 
perturbations, we do not repeat here equations of motion for tensor perturbations. 
Complete equations to determine the density contrast and the velocity field is given by 
equations (|A22|) ( |A24|) and ( |A39| ) , where velocity field is decomposed into the longitudinal 



part and the transverse part, as v 1 = VV + v t- The equation ( |A39| ) is immediately 
integrated to give 

v l T oc a" 2 , (A41) 

i.e., the transverse part decays with time. This result is the consequence of the fact that the 
matter is pressureless. In summary, neglecting the decaying transverse mode, the complete 
equations to determine the density contrast and the velocity field is given by equations 



( A22)-(2.21), where the velocity consists of purely longitudinal part. 



APPENDIX B 

ORTHONORMAL SET OF LAPLACIAN IN THREE DIMENSIONAL 
SPACES WITH CONSTANT CURVATURES 

In this appendix, we construct the orthonormal set of the Laplacian in a space with or 
without spatial curvature and derive the expression of the correlation function in real space 
in terms of the power spectrum, when the spatial curvature is not negligible. 
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B.l. Harmonic Functions 

The Laplacian of a function Q in the metric 7^ of the equations ( |2.3| ) and ( |2.1| ) is given 



by 



-if 



AQ= - 



sinh x 
1 



— smh x^- - 

1 a 



if 



<9x V <9x) + 
9 / 



1 d ( dQ\ 1 d 2 Q 
sin 9 86 \ 89 J sin 2 9 <90 2 
1 <9 2 Q' 



sin^U 

sin#<9#l <9# / sin 2 W 2 



I sin x 



d 2 Q 



_ . 2 dQ\ J_ / . dQ\ _L_ 
dx { X d X J sin 9 89 I «9# i sin 2 <90 2 



(if < 0) 

(if = 0) (Bl) 

(if > 0) 



To evaluate the inverse Laplacian, it is useful to obtain a complete set of scalar harmonic 
functions satisfying the Helmholtz equation (Harrison 1967; Wilson 1983) 

(A + g 2 )Q = 0. (B2) 

If we separate variables, the angular part of the solution is just a spherical harmonic 
Y^iO, 0). The radial part Xi(x), associated with Y" ; m satisfies the following radial equation, 



8 



sinh x ®X 



sinh x 



+ 



2 n W + 1 
v 1 + 1 - 



x 2 <9x 
1 



X 



dx 



+ 



/ . 2 3XA 
sin X - ^ - I + 



X 
.2 



v 



1 



sinh x 
X t = 0, 
Z(Z + 1) 



X, = 0, 



sin 2 x dx V~" * ^X 
where we introduce a new variable u as follows 



sin 2 x 



X = 0, 



(if < 0) 
(if = 0) 
(if > 0) 



(B3) 
(B4) 
(B5) 



Q 



2 2 
g = v , 



-if(^ 2 + l), 



g 2 = if(z/ 2 -l). 



(if < 0) 
(if = 0) 
(if > 0) 



(B6) 
(B7) 
(B8) 



The solutions of radial equations ( p3|) -( p5|) which are regular at the origin are given by 
conical functions, Bessel functions, and toroidal functions for negative, zero, and positive 
curvature, respectively (e.g., Harrison 1967; Abbott & Schaefer 1986): 



X}~\u,x) = (- 1 ) ZM ^^^^^-i 1 /2 2 i( cosh x) 



sinh'x d l / sin^x \ u 2 > q 
v ^(coshx)' \sinhx/' ~~ 



(if < 0) 



(B9) 
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Xr(,,x) = (-l)V^ X ) = ^(^)7^), - 2 >0, (K = 0) (BIO) 



xr&x) = (-ly^'MJ-j—pz^coBx) 

(-lj'sin x g?' /sinz/x\ 



v d(cosx) 1 \ sinx 



i/ = 2,3,4,..., (K>0) (BIT 



where 7-^ is the associated Legendre function, and Pjf(x) = e m ^ 2 V^(x + iO) is the associated 
Legendre function on the cut (Magnus, Oberhettinger & Soni 1966). The spectrum for the 
space of positive curvature is discrete because of the condition that the function is periodic, 
or single- valued. We introduce notations, m\ t \u) = {y 2 ± 1 2 )(^ 2 ± 2 2 ) • • • {y 2 ± I 2 ), and 
Mo = 1. We can see that x\ + \v,x) = i l Xi \—iv,ix) by analytic continuation with a 
natural choice of branches. For x — > 0, all these functions behave like x l with appropriate 
constants, and thus Xi(u, 0) = <5;o (e.g., Harrison 1967). For the variable v is positive 
integers in closed universe, Xj can also be represented by Gegenbauer (or ultraspherical) 
polynomials C*(x) as 



^^eU(co S *). (B12) 



We choose normalizations so that K — > limit of either equation ( |B9| ) or ( |B11| ) reduces to 
equation ( B10| ). In these normalizations, the derivatives and recursion relations for Xi are 
particularly simple. In fact, the derivatives of the radial functions are simply given by 




sinh' x 

X 1 ' 
sm l x 



(K < 0) (B13) 
(K = 0) (B14) 
(K > 0) (B15) 



and the recursion relations, which are derived by the fact that Xi are the solution of the 
radial equations (|Blf)-(|B"5|), are 



(v 2 + l 2 )x£i(v, X ) + (2l + l)^^xt\v,x)+xti(v,x) = 0, (K<0) (B16) 

smh x 

SX®{v, x) + —Xl%, X) + xffifc x) = 0, (K = 0) (B17) 

X 

(z, 2 -/ 2 )x/+ ) (z/, X ) + (2/ + l)^x( + H^, X )+xW(z,, X ) = 0. (K>0) (B18) 

sin x 



In this paper, we need only / = 0, 1, 2, 3, 4 for the evaluation of redshift distortion. They are 
given by 

(B19) 



A o — — r-r — > 
v sinn x 



—o — ( — cosh x sin v\ + v sinh x cos ^x) , 

z/sinh x 



(B20) 



(-) 



z/sinh x 



z/sinh x 



(-) 



for K < 0, and 



z/sinh x 



| 3 — (z/ 2 — 2) sinh 2 x sin z/x — 3z/ sinh x cosh x cos z/x} , (B21) 
jcoshx — 15 + 6(z/ 2 — 1) sinh 2 x sin z/x 
+ z/sinhx 15 — (z/ 2 — 11) sinh 2 x cosz/x}, 
{ [105 - 15 (3z/ 2 - 8) sinh 2 x + (v 4 - 35z/ 2 + 24) sinh 4 x] sin 
- v sinh x [l05 - 10(z/ 2 - 5) sinh 2 x 



(B22) 



vx 



cos z/x 



X. 



(0 



(0 



(0 



X 



xi°> = 



sin z/x 



vx 
1 



1 
1 

^X 4 
1 

^5 



(B23) 

(B24) 
(B25) 

3 - v 2 X 2 ) sin z/x - 3z/x cos z/x] , (B26) 
(-15 + 6z/ 2 x 2 ) sin z/x + ^X (l5 - v\ 2 ) cos z/ X ] , (B27) 
(105 - 45z/ 2 x 2 + v 4 X 4 ) sin z/x - v X (l05 - 10z/ 2 x 2 ) cos z/x] , (B28) 



-sin z/x + vx cos z/x), 



for K — 0, and 



(+) _ sin z/x 

A o — — : 5 

z/smx 



x{ +) = 



1 



(— cos x sin z/x + f sin x cos z/x), 



X^ +) = — ^3— { [3 - (z/ 2 + 2) sin 2 x] sin z/x - 3z/ sin x cos x cos z/x} , 
v sin x 

jcoshx — 15 + 6(z/ 2 + 1) sin 2 x sin z/x 

+ z/sinx 15 — (z/ 2 + 11) sin 2 x cosz/x}, 
{ [l05 - 15(3z/ 2 + 8) sin 2 x+(v 4 + 35z/ 2 + 24) sin 4 x] sin v X 



z/sm x 



(B29) 
(B30) 
(B31) 

(B32) 



I« +) = 



z/ sin x 
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vsmx 



105 — 10(z/ 2 + 5) sin 2 X cosz/^j 



(B33) 



for if > 0. 



Although our normalizations in equations (|B9|) -( [Bl~l| ) have simple relations for 
derivatives and recursion relations, it is also convenient to introduce further normalizations 

as 



V 



(B34) 



From the orthogonality and completeness of conical functions, Bessel functions, and 
Gegenbauer polynomials (Magnus et al. 1966), we can find 



and 



4tt J sinh 2 X dxXi~\u, x)x/-y , X ) = - v'), (if < 0) 



4vr J X 2 dxXl 0) (v,x)Xl \v',X) = ^6{v - v>) 

— 5-<W> 



(If = 0) 



4tt sm 2 xdxX} + \v,x)Xt +) (v',x) 



v 2 dv 
v 2 dv 



xT\u,x)X}->(u,x') 



six - x 1 ) 



An sinh 2 x ' 



xj»)(,, x) ^>(,, x ') = ta2, 

^2 27r 47r sin x 



2tt 2 



(if < 0) 

(if = o) 
(if > o) 



(B35) 
(B36) 



(if > 0) (B37) 



(B38) 
(B39) 
(B40) 



B.2. The Correlation Function in Real Space at Present Time 

The density contrast 8(x, 0, 0) is expanded in terms of the eigenfunctions as follows: 

*(X,M=££ J ^5 lrn {v)X\-\v,x)Yr{eA), (K<0) (B41) 



*(x,M) = E £ 



1=0 m=-l 

X ' ' u 2 du 



8 lm {p)X\°\v,x)Y l m {e^), (K = 0) (B42) 



2vr 2 



Z=0 m=-Z 
co £ co ^2 



*(x,M) = £ £ EyteM^^x)^ 



;=0 m=—l v=3 



2tt 2 



(if > 0) (B43) 
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For a positive curvature model, the term of v = 2 is omitted because u = 2 corresponds to a 
mode which is a pure gauge term (Lifshitz & Khalatnikov 1963; Bardeen 1980) as indicated 
by equation ( |A18| ). The inverse of these expansion is 

8 lm (v) = 4tt| sinhVx J sm9ded4>5(x,e,<l>)Xi-\iy,x)Y l m *(0,(f>), (K < 0) (B44) 

8 lm {v) = 4tt f X 2 d X f sinM^cKx,M)^V,x)V"(M), (K = 0) (B45) 



5 lm {v) = 4vr j sm 2 X d X J sin 9Md<t> 6( X ,0, </>)X{ + \u, X )Yr*(6, <P)- (K > 0) (B46) 

Since the correlation function depends only on the separation of two points, and 
does not depend on the particular choice of the coordinate system, we can write it down as 

«(*) = W>,MMx,M)> 



2vr 2 y 2tt 2 

(,m l,m' 

xX^' o V,O)^' O V^x)^ m *(^0)^\^0)(C(^)W(^)), (# < 0) (B47) 

£(x) = <*(o,MWx,M)> 

oo 2 oo 72 

= y y y — y — 

f - ,f", ^ 2vr 2 2tt 2 

x^ +) (,, Oj^V, X)^ ^) ^&(^L'(^)>- > 0) (B48) 

Statistical homogeneity and isotropy of the universe suggest that correlation of modes has 
the form 

SlMWM) = (2n)% l/ 6 mml 6(u S(u), (K < 0) (B49) 

v A 

{8t m {v)5 Vml {u')) = (2n)% lf 6 mm/ 5 -^fS(u), (K > 0) (B50) 

where S(v) is a power spectrum of the number density field at present. From this equation 
and Xi(u,0) = 8i , equations ( |B47| ) and ( |B48| ) reduce to 



^(X) = J ^xt'°\v, X )S(v), (K < 0) (B51) 

oo 2 

fo) = E X)S(P). (K > 0) (B52) 

u=3 Z7r 



The equation (|B51| ) is an equivalent formula that Wilson (1983) has previously derived. 



These formulas can be even transformed to the forms more like the usual formula: 
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^)=/^ P (*)n^> ^ = °) (B54) 



oo 



«>«> ™ 



i=l 



where the discrete wave number, ki = (z + 2)y/K, is for the space of positive curvature. The 
relations between usual power spectrum P(/c) and the power spectrum S(u) are given by 





\K\ 






|K|3/2 



= S ^ 0) (B56) 

P{k) = S{k), (K = 0) (B57) 

When the scale of interest is much smaller than the curvature scale, x <C |fC| -1 / 2 , both 
expressions (|B53| ) for negative curvature and (|B55|) for positive curvature reduce to the 
familiar expression ( |B54|) . 

Finally, we comment that comparing the expression = (6(xi, <fii)8(X2, 82, <j>z)) 
and the expression ( |B51| ) or ( |B52| ) proves the addition theorem for X[ = Xi . 

Mu,x) =Y,( 21 + 1 )M^Xi)Mv,X2)Pi(cos9). (B58) 
1 

For the flat case K = 0, the above equation is nothing but the well-known addition theorem 
of the Bessel function, therefore, the addition theorem for K 7^ is the generalizations of it 
to the constant curvature space. 
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Fig. 1. — Geometry of the relative position of the observer and the two points. The space is 
not necessarily Euclidean. 




Fig. 2. — Some examples of the function Sj (%). The CDM-type power spectrum with 
T = 0.2(/i _1 Mpc) _1 and "scale invariant" (see text) primordial spectrum is assumed and the 
normalization is arbitrary. The curvature is K = —0.8, 0, +0.8 from the left panel to the 
right panel. Solid lines: E^, dotted lines: Eq~\ dashed lines: long-dashed lines: 

dash-dotted lines: Ef\ 
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z g sin0/zj z 2 sinS/zj z 2 sin0/zj 



Fig. 3. — Contour plots of the correlation function in real space with purely geometrical 
distortions, without velocity distortions. The observer is sitting at the origin, and the first 
point at redshift Z\ is sitting at the center on the y-axis. The contour map shows the value 
of the correlation function depending on the position of the second point at redshift Z2 and 
angle 9. The solid lines indicate positive correlation and the dotted lines indicate the negative 
correlation. The normalization is arbitrary and the contour spacings are Alog 10 |£| = 0.5. 
The top panels are for the STD model (Qq = 1, Ao = 0), the middle for the FLAT model 
(ft = 0.2, A = 0.8), and the bottom for the OPEN model {Q = 0.2, A = 0). From left to 
right panels, the redshifts of the first point z 1 are 0.1, 0.3, 1, 3, respectively. 




0.02 0.04 0.02 0.04 0.02 0.04 0.02 0.04 



z s sinfl z z sin0 z z sin£> z a sinfi 

Fig. 4. — Same as Figure [3], but the scale of z around the first point is fixed. The observer 
is located at (0, —z\), which is outside of the plots. 
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z z sinfl/z, z 2 sinff/zj z 2 sinfi/zj Zjj S i n #/ Zi 

Fig. 5. — Contour plots of the correlation function in redshift space. The meaning of the 
panels are the same as in Figure || but the velocity distortions are included. 
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Fig. 6. — Contour plots of the correlation function in redshift space with fixed scale of z. The 
meaning of the panels are the same as in Figure [|, but the velocity distortions are included. 
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observer observer 



Fig. 7. — Geometrical meaning of the definition of the parallel redshift interval z\\ and the 
perpendicular redshift interval z±. 
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Fig. 8. — The parallel correlation function, £11 (solid lines), and the perpendicular correlation 
function, £± (dashed lines), in redshift space. The redshifts of the first point are 0.1, 0.3, 1, 
3 from left to right panels. The cosmological models are STD, FLAT, and OPEN from top 
to bottom panels. 
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z 10 = 0.003 z 10 = 0.006 z 10 = 0.012 z„ = 0.024 




[degree] 6 [degree] [degree] 9 [degree] 

Fig. 9. — The ratio of the correlation functions by distant observer approximation to that of 
our result. The inclination angle ^ z (see text) is fixed to ^ z = 10° (solid lines), 45° (dotted 
lines), and 80° (dashed lines). The angle 9 between the lines of sight is varied. The redshift 
separation z 12 in velocity space is fixed to 0.003, 0.006, 0.012, 0.024 from left to right panels. 
Thin lines show the approximation by Hamilton (1992) for a nearby universe. Thick lines 
show the approximation by Matsubara & Suto (1996). Top, middle, bottom panels show 
each different cosmological models, STD, FLAT, and OPEN, respectively. 



